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IN THE CLAIMS: 

The text of all pending claims, (including withdrawn claims) is set forth below. Cancelled 
and not entered claims are indicated with claim number and status only. The claims as listed 
below show added text with underlining and deleted text with str i kethrough . When strikethrough 
cannot easily be perceived, or when five or fewer characters are deleted, [[double brackets]] are 
used to show the deletion. The status of each claim is indicated with one of (original), (currently 
amended), (cancelled), (withdrawn), (new), (previously presented), or (not entered). 

1 . (currently amended) A three-dimensional sensor comprising: 

pattern light projecting unit for projecting a slit light or a spot light onto a surface of an 

object; 

a camera that captures a two dim e ns i onal imag e images_of the obiect . including a first 
image when the proiectina unit does not project the slit light or the spot light onto the surface of 
the obiect, and a second image when the projecting unit projects the slit light or the spot light 
onto the surface of the obiect : 

a unit determining a straight line which passes through a measuring point on the object 
and a specific point on said camera from the first image of the object captured by said camera; 

a unit caus i ng s aid cam e ra to captur e th e s li t l ight or th e spot li ght proj e cted by said 
pattern l ight projecting un i t onto tho surfac e of tho object, and determining the surface of the 
object on-which includes said measuring point-exist s using the second image : 

a unit determining a three-dimensional position of said measuring point from the straight 
line detennined by said unit for determining a straight line and the surface determined by said 
unit for determining the surface; and 

a unit calculating an amount of rotation of the object around said measuring point on a 
plane including said surface of the object by comparing a shape of tho image of the entire object 
or part of the object in the first image captured by said camera^ with a prepared reference shape 
of the entire object or part of the object. 

2. (previously presented) A three-dimensional visual sensor which performs a three- 
dimensional measurement of an object, comprising: 

a two-dimensional information acquiring unit; 
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a three-dimensional infornnation acquiring unit; and 
an information combining unit, wherein: 

said two-dimensional information acquiring unit determines a position of a measuring 
point of said object on a two-dimensional image including said object captured by a camera, 
compares a reference image including a characteristic area of the object with an image of said 
characteristic area in said two-dimensional image and determines parameter values that 
describe a transformation expressing geometrical deformation with respect to said reference 
image provided by mapping using said camera, 

said three-dimensional information acquiring unit receives a reflected light of a light 
projected by projecting unit onto said object by unit of light receiving unit to acquire three- 
dimensional information on an inclination of a surface on which said measuring point of said 
object exists and/or a distance from said camera to the surface, and 

said information combining unit combines information acquired by said two-dimensional 
information acquiring unit and information acquired by said three-dimensional information 
acquiring unit based on calibration information of said camera and generates new three- 
dimensional information. 

3. (previously presented) The three-dimensional visual sensor according to claim 2, 
wherein said reflected light is received at a position of the light receiving unit which is the same 
as a position of the camera at which said two-dimensional image is captured. 

4. (original) The three-dimensional visual sensor according to claim 2. wherein said 
camera also serves as said light receiving unit. 

5. (previously presented) The three-dimensional visual sensor according to claim 4, 
wherein said camera is mounted in a robot, and captures said two-dimensional information and 
said three-dimensional information at a same robot position, and the three dimensional visual 
sensor further comprises transforming unit for transforming the new three-dimensional 
information generated by said information combining unit into information expressed in a 
coordinate system of said robot. 
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6. (previously presented) The three-dimensional visual sensor according to claim 5, 
wherein said transforming unit acquires position information of said robot from said robot. 

7. (previously presented) The three-dimensional visual sensor according to claim 5, 
wherein said transforming unit is provided on said robot and the new three-dimensional 
information generated by said information combining unit is transferred to said robot. 

8. (original) The three-dimensional visual sensor according to claim 2, wherein said 
information combining unit comprises: 

means for determining, in the three-dimensional space, a straight line which passes 
through the measuring point on said object and a specific point on said camera; and 

means for determining, based on information on said straight line and the surface on 
which the measuring point on said object exists, an intersection between said surface and said 
straight line. 

9. (previously presented) A three-dimensional visual sensor which performs three- 
dimensional measurement of an object, comprising: 

a two-dimensional information acquiring unit that determines a position of a measuring 
point of said object on a two-dimensional image including said object captured by a camera, 
compares a reference image including a characteristic area of said object with an image of said 
characteristic area in said two-dimensional image, and determines parameter values that 
describe a transformation expressing geometrical deformation with respect to said reference 
image provided by mapping using said camera; 

a three-dimensional information acquiring unit that receives a reflected light of a light 
projected by projecting unit onto said object, by unit of light receiving unit, to acquire three- 
dimensional information on an inclination of a first surface which has a certain positional 
relationship with said measuring point on said object and/or a distance from said camera to the 
surface; 

an information combining unit that combines information acquired by said two- 
dimensional information acquiring unit and the three-dimensional information acquired by said 
three-dimensional information acquiring unit based on calibration information of said camera, 
and generates new three-dimensional information; 

4 



Serial No.: 10/689,721 



a unit for determining a straight line in a three-dimensional space which passes through 
the measuring point on said object and a specific point on said camera; 

a unit for determining, from the information on said first surface, information on a virtual 
second surface which has a certain positional relationship with said first surface and passes 
through the measuring point on said object; and 

a unit for determining an intersection between said straight line and said second surface. 

10. (previously presented) The three-dimensional visual sensor according to claim 9, 
wherein said reflected light is received at a position of the light receiving unit which is the same 
as a position of the camera at which said two-dimensional image is captured. 

11 . (original) The three-dimensional visual sensor according to claim 9, wherein said 
camera also serves as said light receiving unit. 

12. (previously presented) The three-dimensional visual sensor according to claim 10, 
wherein said camera is mounted on a robot and captures said two-dimensional information and 
said three-dimensional information at a same robot position, and the three-dimensional visual 
sensor further comprises transforming unit for transforming the new three-dimensional 
information generated by said information combining unit into information expressed in a 
coordinate system of said robot. 

13. (previously presented) The three-dimensional visual sensor according to claim 12, 
wherein said transforming unit acquires position information of said robot from said robot. 

14. (previously presented) The three-dimensional visual sensor according to claim 12, 
wherein said transforming unit is provided on said robot and the new three-dimensional 
information generated by said information combining unit is transferred to said robot. 

15. (previously presented) The three-dimensional visual sensor according to claim 2 , 
wherein said transformation is an affine transformation. 
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16. (previously presented) The three-dimensional visual sensor according to claim 2 , 
wherein said transformation is a perspective transformation. 

17. (previously presented) The three-dimensional visual sensor according to claim 9 , 
wherein said transformation is an affine transformation. 

18. (previously presented) The three-dimensional visual sensor according to claim 9, 
wherein said transformation is a perspective transformation. 
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